Parallel database backup and restore

ABSTRACT

Embodiments are directed to simultaneously backing up data from multiple locations to a single location and to restoring data from a single location to multiple locations simultaneously. In an embodiment, a computer system receives a backup command from a user which indicates that various specified portions of data are to be backed up. The data portions are stored in multiple different locations in a parallel database. The computer system generates multiple backup commands specific for each location in which the data is stored. The backup commands initiate a parallel backup from the various locations to a single location in a data store. The computer system also executes the generated backup commands in parallel, so that the data from each of the different locations is backed up in the data store.

BACKGROUND

Computers have become highly integrated in the workforce, in the home,in mobile devices, and many other places. Computers can process massiveamounts of information quickly and efficiently. Software applicationsdesigned to run on computer systems allow users to perform a widevariety of functions including business applications, schoolwork,entertainment and more. Software applications are often designed toperform specific tasks, such as word processor applications for draftingdocuments, or email programs for sending, receiving and organizingemail.

In some cases, software applications may be designed to interact withother software applications or other computer systems. For example, asoftware application may be designed to interact with a database orother back-end data store. A client using the software application mayindicate that data is to be backed up on the data store. Such backupsmay include very large amounts of data and, as a result, may take a longtime to complete.

BRIEF SUMMARY

Embodiments described herein are directed to simultaneously backing updata from multiple locations to a single location and to restoring datafrom a single location to multiple locations simultaneously. In oneembodiment, a computer system receives a backup command from a userwhich indicates that various specified portions of data are to be backedup. The data portions are stored in multiple different locations in aparallel database. The computer system generates multiple backupcommands specific for each location in which the data is stored. Thebackup commands initiate a parallel backup from the various locations toa single location in a data store. The computer system also executes thegenerated backup commands in parallel, so that the data from each of thedifferent locations is backed up in the data store.

In another embodiment, a computer system receives a restore command froma user. The restore command indicates that various specified portions ofdata are to be restored from an existing backup which is stored in adata store. The computer system generates restore commands specific foreach location in which the data is stored. The restore commands initiatea parallel restore from the backup in the data store to multiplelocations in the parallel database. The computer system then executesthe generated restore commands in parallel, so that the data from thebackup in the data store is restored in parallel to each of the variousdifferent locations.

This Summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This Summary is not intended to identify key features oressential features of the claimed subject matter, nor is it intended tobe used as an aid in determining the scope of the claimed subjectmatter.

Additional features and advantages will be set forth in the descriptionwhich follows, and in part will be obvious from the description, or maybe learned by the practice of the teachings herein. Features andadvantages of the invention may be realized and obtained by means of theinstruments and combinations particularly pointed out in the appendedclaims. Features of the present invention will become more fullyapparent from the following description and appended claims, or may belearned by the practice of the invention as set forth hereinafter.

BRIEF DESCRIPTION OF THE DRAWINGS

To further clarify the above and other advantages and features ofembodiments of the present invention, a more particular description ofembodiments of the present invention will be rendered by reference tothe appended drawings. It is appreciated that these drawings depict onlytypical embodiments of the invention and are therefore not to beconsidered limiting of its scope. The invention will be described andexplained with additional specificity and detail through the use of theaccompanying drawings in which:

FIG. 1 illustrates a computer architecture in which embodiments of thepresent invention may operate including simultaneously backing up datafrom multiple locations to a single location.

FIG. 2 illustrates a flowchart of an example method for simultaneouslybacking up data from multiple locations to a single location.

FIG. 3 illustrates a flowchart of an example method for restoring datafrom a single location to multiple locations simultaneously.

FIG. 4 illustrates an embodiment of the present invention in which datais restored from a single location to multiple locations simultaneously.

DETAILED DESCRIPTION

Embodiments described herein are directed to simultaneously backing updata from multiple locations to a single location and to restoring datafrom a single location to multiple locations simultaneously. In oneembodiment, a computer system receives a backup command from a userwhich indicates that various specified portions of data are to be backedup. The data portions are stored in multiple different locations in aparallel database. The computer system generates multiple backupcommands specific for each location in which the data is stored. Thebackup commands initiate a parallel backup from the various locations toa single location in a data store. The computer system also executes thegenerated backup commands in parallel, so that the data from each of thedifferent locations is backed up in the data store.

In another embodiment, a computer system receives a restore command froma user. The restore command indicates that various specified portions ofdata are to be restored from an existing backup which is stored in adata store. The computer system generates restore commands specific foreach location in which the data is stored. The restore commands initiatea parallel restore from the backup in the data store to multiplelocations in the parallel database. The computer system then executesthe generated restore commands in parallel, so that the data from thebackup in the data store is restored in parallel to each of the variousdifferent locations.

The following discussion now refers to a number of methods and methodacts that may be performed. It should be noted, that although the methodacts may be discussed in a certain order or illustrated in a flow chartas occurring in a particular order, no particular ordering isnecessarily required unless specifically stated, or required because anact is dependent on another act being completed prior to the act beingperformed.

Embodiments of the present invention may comprise or utilize a specialpurpose or general-purpose computer including computer hardware, suchas, for example, one or more processors and system memory, as discussedin greater detail below. Embodiments within the scope of the presentinvention also include physical and other computer-readable media forcarrying or storing computer-executable instructions and/or datastructures. Such computer-readable media can be any available media thatcan be accessed by a general purpose or special purpose computer system.Computer-readable media that store computer-executable instructions arecomputer storage media. Computer-readable media that carrycomputer-executable instructions are transmission media. Thus, by way ofexample, and not limitation, embodiments of the invention can compriseat least two distinctly different kinds of computer-readable media:computer storage media and transmission media.

Computer storage media includes RAM, ROM, EEPROM, CD-ROM or otheroptical disk storage, magnetic disk storage or other magnetic storagedevices, or any other medium which can be used to store desired programcode means in the form of computer-executable instructions or datastructures and which can be accessed by a general purpose or specialpurpose computer.

A “network” is defined as one or more data links that enable thetransport of electronic data between computer systems and/or modulesand/or other electronic devices. When information is transferred orprovided over a network or another communications connection (eitherhardwired, wireless, or a combination of hardwired or wireless) to acomputer, the computer properly views the connection as a transmissionmedium. Transmissions media can include a network and/or data linkswhich can be used to carry data or desired program code means in theform of computer-executable instructions or data structures and whichcan be accessed by a general purpose or special purpose computer.Combinations of the above should also be included within the scope ofcomputer-readable media.

Further, upon reaching various computer system components, program codemeans in the form of computer-executable instructions or data structurescan be transferred automatically from transmission media to computerstorage media (or vice versa). For example, computer-executableinstructions or data structures received over a network or data link canbe buffered in RAM within a network interface module (e.g., a “NIC”),and then eventually transferred to computer system RAM and/or to lessvolatile computer storage media at a computer system. Thus, it should beunderstood that computer storage media can be included in computersystem components that also (or even primarily) utilize transmissionmedia.

Computer-executable instructions comprise, for example, instructions anddata which cause a general purpose computer, special purpose computer,or special purpose processing device to perform a certain function orgroup of functions. The computer executable instructions may be, forexample, binaries, intermediate format instructions such as assemblylanguage, or even source code. Although the subject matter has beendescribed in language specific to structural features and/ormethodological acts, it is to be understood that the subject matterdefined in the appended claims is not necessarily limited to thedescribed features or acts described above. Rather, the describedfeatures and acts are disclosed as example forms of implementing theclaims.

Those skilled in the art will appreciate that the invention may bepracticed in network computing environments with many types of computersystem configurations, including, personal computers, desktop computers,laptop computers, message processors, hand-held devices, multi-processorsystems, microprocessor-based or programmable consumer electronics,network PCs, minicomputers, mainframe computers, mobile telephones,PDAs, pagers, routers, switches, and the like. The invention may also bepracticed in distributed system environments where local and remotecomputer systems, which are linked (either by hardwired data links,wireless data links, or by a combination of hardwired and wireless datalinks) through a network, both perform tasks (e.g. cloud computing,cloud services and the like). In a distributed system environment,program modules may be located in both local and remote memory storagedevices.

FIG. 1 illustrates a computer architecture 100 in which the principlesof the present invention may be employed. Computer architecture 100includes computer system 110. Computer system 110 may be any type oflocal, distributed, fixed or mobile computing system. The computersystem may include various different modules and nodes configured toperform different functions. For instance, the computer system mayinclude a command receiving module 115 that is configured to receivecommands from a user 105. The user may, for example, send backup command106 or provide other input 131. The command receiving module may receiveand interpret these commands. The interpreted commands may then be sentto the backup command generating module 120.

The backup command generating module 120 may be configured to generatemultiple commands from a single command. In some embodiments, computersystem 110 may comprise a parallel database. The term “paralleldatabase”, as used herein, may refer to a database that is configured toread and write large groups of data in parallel. Multiple read (orrestore) commands can be issued together and carried out simultaneously.Similarly, write commands can be issued together and executedsimultaneously in the parallel database. The data is stored on multipledifferent data storage nodes (e.g. 125A-D).

Thus, the backup command generating module may take the user's backupcommand 106 and generate multiple backup commands based thereon (e.g.backup commands 121A-D). Although four backup commands are shown in FIG.1, it will be understood that substantially any number of backupcommands may be generated by module 120. In some cases, module 120generates as many backup commands as there are data storage nodes (e.g.125A-D).

After generation, the generated backup commands 121A-D may be sent tocorresponding data storage nodes. Thus, as shown in FIG. 1, backupcommand A (121A) may be sent to data storage node 125A, backup command B(121B) may be sent to data storage node 125B, backup command C (121C)may be sent to data storage node 125C and backup command D (121D) may besent to data storage node 125D. In response to the received backupcommands, each data storage node may send the data that is to be backedup (e.g. data 126A-D) to backup node 130. The data may be backed up onbackup node 130 in a single location. The backup may be transferable toother people or other storage locations. The backup node may indicate tothe receiving module the status of the backup. The receiving module maythen send a reply message 132 to the user 105 indicating that the backupwas successful (or, if the backup failed, a failure indicationexplaining the cause of the failure). As will be shown in reference toFIG. 4, data can be restored in parallel from the stored backup.

Backing up a database may include three types of data: database data,metadata, and backup information. The database data is the actual users'data. The metadata is the information used by the parallel database tolink all of the underlying database server objects together to make themparallel database objects. The backup information is the data created bythe backup process which is used to catalog information about the backupso it may be used for a data restore. The backup information identifieswhere each portion of data was stored prior to the backup (i.e. on whichdata storage nodes 125A-D the data was stored). Once a database isbacked up, a user may move or copy the data backup to any location (e.g.to a tape drive, to a different computer, to an external hard drive, orother data store).

In some cases, a folder is created on the backup node 130. The backed updata is stored on the backup node. The folder holds and maintains thebacked up information. The name of the folder may be the name of thebackup, and all information related to the backup, including thedatabase data, metadata and backup information, is placed inside thefolder. In some embodiments, backup commands may be encased inside aparallel database query plan. Since the commands are inside a paralleldatabase query plan, a parallel database query engine may execute thisplan like any other plan. This allows the commands to be executed inparallel across the computer system's compute nodes.

Prior to issuing the parallel backup commands 121A-D, backup files maybe pre-allocated on the destination computer system with the same namesthat the individual nodes back up to. This pre-allocation may increasedata input and output within the computer system. In some cases, whenthe backup command generating module is generating the backup commands,one or more performance options may be added. The options may include anoption to increase the parallelism, increase or decrease compression,etc.

Backing up the parallel database metadata information may beaccomplished by using a two-step process. The first step may involveinstantiating a temporary database and copying the necessary informationfrom a parallel database-specific metadata (including catalog orprivileges information) into this temporary database. The second stepmay include backing up the data to the temporary database, and from thetemporary database to the backup node. Once the backup is complete, thetemporary database is discarded.

Restoring a database may similarly involve database data, metadata andbackup information. The data is the actual backup files that weregenerated and stored on the backup node. The metadata information isused by the parallel database engine to link all the underlying paralleldatabase server objects together to make them parallel database objects.The backup information was created by the backup process and is used bythe restore process to generate a restore plan. In some embodiment, therestore may include the following steps: use the backup information togenerate a restore plan, use the parallel database's restore feature torestore the data to the appropriate data storage nodes (125A-D), restorethe metadata information, and extend the database if necessary.

In some cases, the restore commands may be encased inside a paralleldatabase query plan. Since the restore commands are inside a plan, theparallel database engine's distributor may execute this plan like itwould other plans. This allows the commands to be executed in parallelacross the compute nodes. As with the backup commands, when building therestore commands, performance options may be available (e.g. increaseparallelism, increase/decrease compression, etc.).

In view of the systems and architectures described above, methodologiesthat may be implemented in accordance with the disclosed subject matterwill be better appreciated with reference to the flow charts of FIGS. 2and 3. For purposes of simplicity of explanation, the methodologies areshown and described as a series of blocks. However, it should beunderstood and appreciated that the claimed subject matter is notlimited by the order of the blocks, as some blocks may occur indifferent orders and/or concurrently with other blocks from what isdepicted and described herein. Moreover, not all illustrated blocks maybe required to implement the methodologies described hereinafter.

FIG. 2 illustrates a flowchart of a method 200 for simultaneouslybacking up data from a plurality of locations to a single location. Themethod 200 will now be described with frequent reference to thecomponents and data of environment 100.

Method 200 includes an act of receiving a backup command from a user,the backup command indicating that one or more specified portions ofdata are to be backed up, wherein the data portions are stored in aplurality of different locations in a parallel database (act 210). Forexample, command receiving module 115 may receive backup command 106from user 105 indicating that various user-specified portions of dataare to be backed up. The data may be any type of data that is digitallystorable. The data portions may comprise data related to a certainapplication, data from within a certain time period, data pertaining tothe user or other data. The data is stored on one or more data storagenodes (e.g. 125A-D) in the parallel database (e.g. computer system 110).

The backup command may be parsed and authenticated prior to generatingthe plurality of backup commands. The parsing may identify certainportions or specific commands within the backup command. The data backupcommands may be received at a dedicated node that receives and storesthe backup data (e.g. command receiving module 115). The user may beable to send the backup command to the command receiving module and,with a single command, cause the backup to begin backing up theindicated data to the backup node.

Method 200 includes an act of generating a plurality of backup commandsspecific for each location in which the data is stored, the backupcommands initiating a parallel backup from the plurality of locations toa single location in a data store (act 220). For example, backup commandgenerating module 120 may generate backup commands 121A-D which arespecific for each location in which the data is stored (e.g. datastorage nodes 125A-D, respectively). The backup commands may beconfigured to initiate a parallel backup from the data storage nodes tobackup node 130. Each of the generated backup commands may comprise aspecialized command that is syntactically different than the otherbackup commands. Thus, for example, backup command 121A that isgenerated for data storage node 125A may be syntactically different thanbackup command 121B that is generated for data storage node 125B (and soon for backup commands 121C, 121D and any other backup commands). Asmentioned above, in some cases, one or more portions of data that are tobe backed up to one or more specified backup locations may bepre-allocated, before receiving the request to back up the data.

Method 200 includes an act of executing the generated backup commands inparallel, such that the data from each of the plurality of differentlocations is backed up in the data store (act 230). For example,computer system 110 may execute the generated backup commands 121A-D inparallel. In this manner, each portion of data 126A-D is sent to thebackup node at the same time. The data is received by and written to thebackup node 130 where it is stored for later access. Portions ofcorresponding metadata may be sent along with the backup data. At leastin some cases, the metadata may indicate where each portion of thebackup data was stored (i.e. on which data storage node the data wasstored). In some cases, the data files of the data backup may be viewedby a user in a single folder on the backup node. The files may appear tobe in the same folder, regardless of where the data files are actuallystored.

In some embodiments, the computer system may be an integrated computingsystem or appliance computing system that includes processing resources,storage resources and networking resources. The appliance computingsystem may be pre-loaded with parallel database software, such that theparallel database processing and storage occurs on the appliance, whereeach of the appliance components communicate via a high speed internalnetwork. In such an embodiment, the backup command 106 may be receivedand processed at the appliance computing system. The appliance computingsystem may include hardware and installed software for the interfacingwith the appliance, and with its individual components. Using thisinterface, the user 105 may be able to access the stored backup and movethe backup to a different location if desired.

It will be understood that the data backups may be full backups ordifferential backups. Full backups may be configured to back up all theinformation indicated by the user. Differential backups may be performedwhen a backup of the user-specified data has already been performed. Thedifferential backup may be configured to back up only the changes in thefiles since the last time the data was backed up. Regardless of whichbackup type is performed, the backup may provide data consistency acrossthe data store nodes by creating a point-in-time image of the data forwhich the backup command was received. This image may be stored,archived, moved or otherwise transferred to another data storagelocation.

Turning now to FIG. 3, FIG. 3 illustrates a flowchart of a method 300for restoring data from a single location to a plurality of locationssimultaneously. The method 300 will now be described with frequentreference to the components and data of environment 400 of FIG. 4.

Method 300 includes an act of receiving a restore command from a user,the restore command indicating that one or more specified portions ofdata are to be restored from an existing backup, wherein the data backupis stored in a data store (act 310). For example, command receivingmodule 415 of computer system 410 may receive restore command 406 fromuser 405. The restore command may specify various portions of data thatare to be restored from an existing backup, stored on backup node 425.In some cases, the user may be able to specify that all of the user'sdata is to be restored from a backup with a single command.

Method 300 includes an act of generating a plurality of restore commandsspecific for each location in which the data is stored, the restorecommands initiating a parallel restore from the backup in the data storeto a plurality of locations in the parallel database (act 320). Forexample, restore command generating module 420 may generate restorecommands 422A-D which are specific to data storage nodes 421A-D,respectively. The restore commands may be configured to initiate aparallel restore from the stored backup to the data storage nodes. Thedata storage nodes may read the data from the backup in parallel. Insome cases, metadata corresponding to the backup data may be accessed todetermine which data storage node each portion of data is to be sent to.The metadata may also be used to indicate other associated informationsuch as the owner of the data, the date and time the data was backed up,and other information.

Method 300 includes an act of executing the generated restore commandsin parallel, such that the data from the backup in the data store isrestored in parallel to each of the plurality of different locations(act 330). For example, computer system 410 (which, at least in someembodiments, comprises a parallel database) may execute generatedrestore commands 422A-D in parallel. In this manner, the data 426A-Dfrom the backup node is restored to the corresponding data storage nodes421A-D in parallel. In some cases, the data may be restored from asmaller number of nodes (e.g. on a smaller appliance) to a larger numberof data storage nodes (e.g. on a larger appliance). The data may beautomatically redistributed among the larger number of nodes. Therestored backup may provide data consistency across the data store nodesby restoring a point-in-time image of the data for which the restorecommand was received. Thus, a user may opt to restore selected portionsof data, or restore an entire point-in-time image of the user's data.

Accordingly, methods, systems and computer program products are providedwhich simultaneously back up data from a plurality of locations to asingle location. Moreover, methods, systems and computer programproducts are provided which restore data from a single location to aplurality of locations simultaneously.

The present invention may be embodied in other specific forms withoutdeparting from its spirit or essential characteristics. The describedembodiments are to be considered in all respects only as illustrativeand not restrictive. The scope of the invention is, therefore, indicatedby the appended claims rather than by the foregoing description. Allchanges which come within the meaning and range of equivalency of theclaims are to be embraced within their scope.

We claim:
 1. At a computer system including at least one processor and amemory, in a computer networking environment including a plurality ofcomputing systems including plurality of data storage nodes and a backupnode, a computer-implemented method for simultaneously backing up datafrom the plurality of data storage nodes to the backup node, the methodcomprising: an act of the computer system receiving a backup commandfrom a user, the backup command indicating that a specified portion ofdata of a parallel database is to be backed up to a backup node, whereinthe specified portion of data is stored across a plurality of differentdata storage nodes of the parallel database; based on receiving thebackup command, an act of the computer system generating a plurality ofbackup commands, including generating a different backup command foreach of the plurality of data storage nodes, each different backupcommand being configured to instruct the corresponding data storage nodeto initiate a backup of a corresponding piece of the specified portionof data that is stored at the corresponding data storage node, such thatthe plurality of backup commands are configured to initiate a parallelbackup from the plurality of data storage nodes to a single data storeat the backup node; and an act of the computer system initiatingexecution of the generated plurality of backup commands at each of theplurality of data storage nodes in a parallel manner, such that thecorresponding piece of data from each of the plurality of different datastorage nodes is backed up in the data store at the backup node inparallel.
 2. The method of claim 1, wherein the received backup commandis parsed and authenticated by the computer system prior to generatingthe plurality of backup commands.
 3. The method of claim 1, wherein oneor more corresponding portions of metadata stored in the data storeindicate where each portion of the backup data was stored.
 4. The methodof claim 1, wherein each of the generated backup commands comprises aspecialized command that is syntactically different than the otherbackup commands.
 5. The method of claim 1, wherein the backup nodepre-allocates one or more files on the data store, each filecorresponding to a different one of the plurality of different datastorage nodes, prior to the computer system initiating execution of thegenerated plurality of backup commands.
 6. The method of claim 1,wherein data files of the data backup are viewed by a user in a singlefolder on the data store, regardless of where the data files areactually stored.
 7. The method of claim 1, wherein the backup command isreceived at a dedicated backup node that receives and stores backupdata.
 8. The method of claim 1, wherein the backup is initiated by asingle backup command to a single computer system.
 9. The method ofclaim 1, wherein the backup command is received and processed at anintegrated computer system, wherein the integrated computer systemincludes an interfacing computer system that receives user inputs and aplurality of data backup nodes, wherein the data backup nodes of theintegrated computer system communicate via internal communication links.10. The method of claim 9, wherein the integrated computer systemincludes hardware and installed software of the interfacing computersystem, the data backup nodes and the internal communication links. 11.The method of claim 1, wherein the stored backup is configured to beaccessed and moved to a different location by one or more users.
 12. Themethod of claim 1, wherein the backup performed comprises at least oneof a full backup or a differential backup.
 13. The method of claim 1,wherein the backup provides data consistency across the plurality ofdata storage nodes by creating a point-in-time image of the specifiedportion of data for which the backup command was received.
 14. Themethod of claim 1, wherein each different backup command beingconfigured to instruct the corresponding data storage node to initiate abackup of a corresponding piece of the specified portion of data that isstored at the corresponding data storage node comprises each differentbackup command being configured to write the corresponding piece of thespecified portion of data to a corresponding file in a directory at thedata store, each corresponding file corresponding to and being namedaccording to each data storage node and the directory corresponding tothe parallel database.
 15. A computer system comprising the following:one or more processors; system memory; one or more computer-readablestorage media having stored thereon computer-executable instructionsthat, when executed by the one or more processors, causes the computingsystem to perform a method for simultaneously restoring data from asingle backup node to a plurality of data storage nodes, the methodcomprising the following: an act of receiving a restore command from auser, the restore command indicating that a specified portion of data ofa parallel database is to be restored from an existing data backup at abackup node, wherein the data backup is stored in a data store at thebackup node; based on receiving the restore command, an act ofgenerating a plurality of restore commands, including generating adifferent restore command for each of a plurality of data storage nodesof the parallel database, each different restore command beingconfigured to instruct the corresponding data storage node to initiate arestore of a corresponding piece of the specified portion of data thatis stored at the existing data backup, such that the plurality ofrestore commands are configured to initiate a parallel restore from theexisting data backup in the data store to each of the plurality of datastorage nodes of the parallel database; and an act of initiatingexecution of the generated plurality of restore commands at each of theplurality of data storage nodes in a parallel manner, such that eachcorresponding piece of data from the existing data backup in the datastore is restored in parallel to each corresponding data storage node.16. The computer system of claim 15, wherein the existing data backupincludes corresponding pieces of data from a first number of datastorage nodes, but the existing data backup is restored to a secondnumber of nodes, the second number of nodes being greater in number thanthe first number of nodes.
 17. The computer system of claim 16, whereinrestoring the existing data backup includes redistributing the existingdata backup among the second number of nodes.
 18. The computer system ofclaim 15, wherein a portion of corresponding metadata stored with theexisting data backup is accessed to determine which location each pieceof data is to be sent to.
 19. The computer system of claim 15, whereinthe restored backup provides data consistency across the data storagenodes by restoring a point-in-time image of the data for which therestore command was received.
 20. A computer system comprising thefollowing: one or more processors; system memory; one or morecomputer-readable storage media having stored thereoncomputer-executable instructions that, when executed by the one or moreprocessors, causes the computing system to perform a method forsimultaneously backing up data from a plurality of data storage nodes toa backup node, the method comprising the following: an act of receivinga backup command from a user, the backup command indicating that aspecified portion of data of a distributed parallel database is to bebacked up to a backup node, wherein the specified portion of data isstored across a plurality of different data storage nodes of thedistributed parallel database; based on receiving the backup command, anact of generating a plurality of backup commands, including generating adifferent backup command for each of the plurality of data storagenodes, each different backup command being configured to instruct thecorresponding data storage node to initiate a backup of a correspondingpiece of the specified portion of data that is stored at thecorresponding data storage node, such that the plurality of backupcommands are configured to initiate a parallel backup from the pluralityof data storage nodes to a single data store at the backup node, suchthat the backup data is accessible and transferable by a user from thedata store; and an act of initiating execution of the generatedplurality of backup commands at each of the plurality of data storagenodes in a parallel manner, such that the corresponding piece of datafrom each of the plurality of different data storage nodes is backed upin parallel to the data store at the backup node, wherein a portion ofcorresponding metadata is stored with the backup data to indicate whichdata storage node each portion of data was received from.